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ABSTRACT 

An evaluation was done of New York City Public 
Schools 1 Career Awareness and Resource Education Program for Hispanic 
Bilingual High School Students (Project CARE), which served poor 
immigrant students. The program operated at 2 high schools (1 in 
Brooklyn and 1 in Queens) and included 491 students who were eligible 
for the Free Lunch Program. The Project provided students with 
English as a Second language (ESL) ; native language arts (NLA) ; 
bilingual instruction in content areas and pre-occupational subjects; 
and art, music, and physical education using ESL techniques. The 
Project aimed to provide academically deficient students of limited 
English proficiency with the intensive instructional and support 
services necessary to insure optimum academic and career achievement. 
Evaluation of the program was based on demographic data, citywide 
student test scores, and interviews with and surveys of the program 
director. Project CARE was fully implemented; and it met its 
objectives for awareness of U.S. culture, career conference, guidance 
counseling, attitudes toward school, curriculum development, and 
parental involvement. It partially met its objective for dropout 
rate. The project did not meet its objectives for ESL, NLA, content 
areas subjects, attendance, and attitude toward heritage. One 
appendix summarizes the data collection and analysis procedures. 
(JB) 
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FOREWORD 



The body of this report ts preceded by an Extract which presents an overview of salient points of 
the project: funding cycle; enrollment figures; background of students served; admission criteria; and 
programming features, strengths, and limitations, including the outcome of all objectives. The extract also 
presents the conclusions drawn by the Office of Research, Evaluation, and Assessment (OREA) about the 
program and its recommendations for program improvement. 

The extract is followed by the body of the report, titled Propam Assessment. This includes such 
information as staffing, program implementation, and outcome and implementation objectives. 
Instructional objectives are presented first, followed by noninstructional objectives. The report then 
addresses those aspects of programming mandated by Title VI! regulations that do not have specifically 
stated objectives. This may be information on attendance and dropout rate, grade retention, 
mainst reaming, referrals out of the program to meet special needs of the students, and withdrawals. A 
case history concludes the report. 

Data for this profile were collected and analyzed using a variety of procedures, which are 
described in Appendix A following the text. 
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PROJECT DIRECTOR: Eikcn May 
SITES 



ING CYCLE. Year 3 of 3 



ftchool 

Eastern District High School 
Mushing High School 



Borough Grade Levels 



Enrollment* 



Brooklyn 
Queens 



9-12 
9-12 



(fall) 
250 
127 



(spring) 
299 
126 



♦The project enrolled 491 students (100 less than in the previous year), serving 377 in the fall and 425 in the 
spring: 355 students were enrolled for both semesters. 

STUDENT BACKGROUND 

Native Language Number of Students 



Spanish 
Unreported 



480 
11 



Countries of Origin 


Number of 


Dominican Republic 


280 


Puerto Rico 


48 


Ecuador 


35 


Mexico 


22 


£1 Salvador 


20 


Other countries 


62 


Unknown 


24 



Mean Years of Education in Native Country : 7.2; in the United States: 2.3 
Percentage of Students Eligible for Free Lunch Program : 100 



ADMISSION CRITERIA 

Students were eligible to participate if they scored at or below the 40th percentile on the Language 
Assessment Battery (LAB), failed two or more subjects in the term prior to entry, and/or had scored at or below 
the 55th percentile on the Spanish LAB. 

PROGRAMMING 

Features 

Project CARE targeted two high schools with a recent influx cf immigrants. The project provided 
students with English as a Second Language (E.S.L.): Native Language Arts (N.L.A.); bilingual instruction in 
content area and pre-occupational subjects; and art, musk:, and physical education using E.S.L, techniques. 
Project CARE aimed to provide academically deficient students of limited English proficiency (LEP) with the 
intensive instructional and support services necessary to insure optimum academic and career achievement. 



Strengths and Limitations 



Program strengths were the strong relationship developed between resource teachers and program 

students and the additional instructional support provided in the resource room- 
Program limitations varied bei*een sites. At Hushing High School project staff wished for greater access 

to computers and better response to pi rental involvement initiatives. Project staff fell that more guidance 

sessions with program students and in Teased contact with community and cultural organizations were needed at 

Eastern District High School to enrich the program's support services. 



CONCLUSIONS AND RECOMMENDATIONS 

Project CARE was fully implemented. The project met hs objectives for awareness of American culture, 
career conference, guidance counseling, attitudes toward school curriculum development, and parental 
involvement. It met one of two staff development objectives. It partially met its objective for dropout rate. 
Project CARE did not meet its objectives for E.S.L., N.UA., content area subjects, attendance, and attitude 
toward heritage. While the project failed to meet any of its academic objectives, OREA notes that Project CARE 
admitted only students with a history o f academic failure and considers that these objectives may have been 
unrealistic for the population served. 

The conclusions, based on the findings of this evaluation, lead to the following recommendations: 

• Offer project students at Flushing High School greater access to computers. 

• Conduct a needs assessment survey of parents of participating students at Flushing High School to 
increase their involvement. 

• If possible, schedule additional guidance sessions for program students at Eastern District High 
School. 

• Increase contact with community and cultural organizations at the Eastern District High School site. 

• Revise academic objectives to make them more realistic for the population being served. 



PROGRAM ASSESSMENT 



STAFFING 

Title VII Staff (Total 5) 
Title 

Project Ditector 
Resource Teacher 
Resource Teacher 
Paraprofessional 
Paraprofessional 



Degree 

Master's, P.D.* 
Master's 
Bachelor's 
High School 
High School 



Language Competencies 
Spanish 
Spanish 
Spanish 
Spanish 
Spanish 



'Professional Diploma 

Other Staff Working With Project Students (Total 74 fall, 83 spring) 



D_egree 

No data provided 



Certification 

T.P.D. E.S.L. 5 

T.P.D Spanish 4 

Spanish BQ./N.L.A 26 

E.S.L 19 

English 4 

Korean N.LjV 1 

French BU./N.L.A. 3 

Chinese BU./N.L.A. 3 



language Competencies 
Spanish 39 
French 3 
Korean 1 



IMPLEMENTATION AND OUTCOMES (Objectives prefaced by •) 

English as a Second Language fE.S.L.) 

Level P eriods Weekly 

Literacy 15 
Beginning 15 
Intermediate 15 
Advanced 10 
Transitional 10 

E.S.L. teachers used a variety of texts and other instructional materials which focused on the use of 
English in everyday situations. They also used skits and pictures to contextualize vocabulary, grammar, and 
writing instruction. 



• Seventy percent of program students will demonstrate an appropriate increase in English language 
proficiency. 

Evaluation Instrument: Language Assessment Battery (LAB)* 
Pretest: March 1990; posttesi: March 1991. 

Number of students for whom pre- and posttesi data were reported: 320 
Percentage of students showing gain: 363 
Project did not meet objective. 

Native Language Arts fNX.A.1 (Spanish) 

Estimated percentage of students lacking literacy skills in native language: 32 

Level Periods Weekfr 

Literacy 10 
Beginning 5 
Intermediate 5 
Advanced 5 
Advanced Placement 5 

N.L.A teachers emphasized a holistic approach to learning using texts, materials, and topics focusing on 
students' cultural heritages. Project CARE also encouraged teachers to use the individualized instructional 
approach and mastery learning techniques in order to give program students the additional instructional attention 
needed. 

• Seventy-five percent of the Spanish-dominant participants will demonstrate a significant increase in 
Spanish language achievement. 

Evaluation Indicator: Final course grades. 

In the fall, 63.4 percent of the 309 students enrolled passed N.l~A. In the spring, 312 students were 
enrolled, and 65.7 percent of these passed. 

Project did not meet objective. 



*OREA used a gap reduction design to evaluate the effect of supplementary instruction on project students' 
performance on the LAB. Since all LEP students in New York City are entitled to such instruct ion, no valid 
comparison group exists among these students, and OREA used instead the group on which the LAB was 
normed. Test scores arc reported in Normal Curve Equivalents (N.C.E.S), which are normalized standard scores 
with a mean of 50 and a standard deviation of 21.06. It is assumed that the norm group has a zero gain in 
N-C.E.s in the absence of supplementary instruction and that participating students' gains are attributable to 
project services. 
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Cpnieni Area Subjects 

Project students took bilingual contest area courses in mathematics, science, social studies, and business 
education. Project CARE also encouraged participating subject teachers to implement personalized teaching 
approaches in their classrooms. Materials included project-developed, translated, and/or adapted texts; Barron's 
scries in social studies (a sequence of FA Mundn Y Su Gente readers on the cultures and histories of the world); 
and Spanish versions of texts used hi the mainstream curriculum. 

• At least 70 percent of all students will score at or above the passing criterion of 65 in the content 
area subjects of social studies, mathematics, and science. 

Evaluation Indicator: Final course grades. 

Passing Grad es in Content Area Courses 

FaH ... SPP"S 

Enrollment Percent Passing Enrollment Percent passing 

Mathematics 331 43.8 331 52.9 

Science 171 38.6 216 56*5 

Social studies 301 56.5 318 58.5 

Project did not meet objective, although spring passing rates were higher than fall rates for all subjects. 
Attendance 

• Program students' attendance will be significantly higher than that of mainstream students. 

Attendance Rates 

School project Students' Rate Mainstream S tudents' Rate Difference 

Eastern District High School 753 78.4 -3.1 

Flushing High School 85.1 89.1 -4 0 

Project did not meet objective. 
Dropout Rate 

• Program students will have a significantly lower dropout rate than similar non-program students. 

Dropout Rates 

Scnooi Project Students' Rate Mainstream S tudents' Rate pifferencg 

Eastern District High School 0.0 10 0 

Hushing High School 6.3 5.8 0.5 

"c<.05 

Project met objective only at Eastern District High School. 
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Altitudes Toward School 

• Seventy-five percent of all students will demonstrate an improvement in attitude toward school. 
Evaluation Instrument: 5 -point Liken Kale. 

Data were available for 294 students. Of these, 77.0 percent showed an improvement of one or more 
points in the scale. 

Project met objective. 

Attitude Toward Heritage 

• Seventy-five percent of all students will demonstrate an improvement in attitude toward one's 
heritage. 

Evaluation Instrument: Language Cultural Heritage At'Uude Scale 

Data were available for 294 students. Of these, 72.5 percent showed an improvement of one or more 
points in the scale. 

Project did not meet objective, although it came dose. 

American Culture Awareness 

• The program will organize at least two field trips at each site to historical museums, the United 
Nations, etc., to increase familiarity with American culture and citizenship. 

Program students at both sites went on numerous field trips to cultural institutions. Some focused on 
American history, and others centered on ecological awareness and multiculturalism. 

Project met objective. 
Career Conference 

• The program will organize at least one conference for the students in whtch representatives of 
business and industry will present information on career options and skill requirements. 

Project students participated in numerous career awareness activities, ranging from visits by individual 
professionals to full-fledged career conferences. Students learned about the fundamental skills requirements, 
necessary education, and financial benefits of several careers. 

Project met objective. 
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Guidance Counseling 

• All graduating siudents will meet with the bilingual career specialists for advisement at least three 
times during the school year. 

Ail graduating students met with the bilingual career specialists twice, the college advisors twice, and with 
the bilingual grade advisor twice. The project also offered career guidance handbooks for independent research. 
The career specialists at each school met all siudents an indeterminate number of times. 

Project met objective. 
Staff Development 

• Eighty percent of the staff will demonstrate an increase in awareness of pupil needs and pupil 
problems. 

Evaluation Instrument: 5-point Likert scale. 

Likert-scale data indicated that 100 percent of staff had become more aware of pupil needs and problems 
and more involved in project activities. 

Project met objective. 

• Ninety percent of program staff will enroll in at least one university course. 

Eigbtv-five percent of the program staff enrolled in university or college courses at Eastern District High 
School and 86 percent at Flushing High School. Veteran teachers uho had fully completed license requirements 
did not enroll in any courses. 

Project did not meet objective, although it came close. 
Curriculum Development 

• Curriculum specialists will have developed or translated one subject matter-oriented instruction unit 
for teaching E.S.L.. mathematics, science, and social studies. 

The project's curriculum specialists produced six pieces of curriculum, one for N.L.A. Spanish, advanced 
level; two for N.L.A. Spanish, literacy level; one for E.S.L., transitional level; and two for E.S.L., literacy level. 
Project staff assembled developed materials into books, which they disseminated to participating teachers and 
shared with other high schools. 

Project met objective. 
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Parental Involvement 

• The proportion of program students' parents who participate in Open School Day/Evening will be 
equal to or greater than the proportion of mainstream students' parents who participate in this 
activity. 

Parent Attendance Rates 

Fall Soring 

Program Rate Mainstream Rate Program Rate Mainstream Rata 

Eastern District High School 27.2 20.0 49 J? 

Flushing High School 17.6 173 30 21 

Project met objective. 



Other Activities 

The project provided students with a variety of extracurricular activities and support services. These 
included crisis intervention, peer tutoring, computer-assisted instruction, academic contests, and placement in 
service aide positions. Students also worked on a magazine featuring their poetry and other literary and artistic 
contributions. 



SERVICE TO STUDENTS WITH SPECIAL NEEDS 

Percentage in Percent 

Number of Students Percentage Previous Year Change 

Referred to special education: 0 0 N/A N/A 

Referred to remedial programs: 0 0 N/A N/A 

Referred to gifted and talented programs: 0 0 N/A N/A 

Retained in grade: 7 1.4 N/A N/A 

Dropouts: 12 2.4 16.4 -14.0 

Project CARE staff referred students for special education programs if they were identified by project or 
other school staff to be in academic or emotional need. The School-Based Support Teams (S.B.ST.s) were 
ultimately responsible for certifying students for special education. The S.B.S.T. included members who were 
proficient in the project students' native language. 



MAIN'STREAMINO 

Thirty-eight students (7.7 percent) were ma in streamed. 



Academic Achievement of Former Project Participants Who Were Ma instreamed 

t 

No data were available on former project students. 

} 
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CASE HISTORIES 



Eastern District High School 

David L. was born in Nicaragua in 1974 and moved with his family to New York in the spring of 1988. 
He enrolled in Eastern District High School that fall, and testing showed that he was very intelligent. He was 
placed in advanced level mathematics classes. However, David's academic performance proved inconsistent, and 
he was failing several of his classes. He was then opted into the Project CARE program, and the resource 
teacher found that it was David's troubled family/home situation watch was jeopardizing his academic success. 
David lived in an abusive home, frequently slept on the subways, and had only two changes of clothing. This 
hampered his ability to concentrate on his school work and diminished his self-esteem. Project CARE'S resource 
teacher intervened on David's behalf, getting him into a group home, securing for him the services of a 
professional counselor, and providing him with a small wardrobe. 

Today, Project CARE's resource room has become something of a second home to David. His grades 
have improved, and he has become very involved with school activities. He cited the project's intensive 
instructional and support services as critical to his personal success. 

Flushing High School 

Roberto M. enrolled in September 1991, after graduating from one of the neighboring intermediate 
schools. His score on the LAB indicated that he was still LEP, and his academic performance was poor. He then 
enrolled in Project CARE, developed a strong relationship with project staff, and was especially active in program 
activities. Because he worked after school until 11 p.m., he went to the resource room during his lunch period 
every day for help in English. 

The paraprofessional used Roberto's interest in computers as a way to help him improve his language 
skills and complete his homework more efficiently. While his computer skills and self-esteem improved, his 
grades did not. Project CARE's resource teacher and paraprofessional then decided to pair Roberto with an 
English-speaking student in the mainstream program. This peer-tutoring relationship proved to be a turning point 
in Roberto's academic career. Roberto's grades began to show significant improvement, and his self-esteem 
improved dramatically. Soon, Roberto passed all his courses and was himself tutoring one of the project's pre- 
literacy students. He also maintained a very active 'ole in project activities and began to go to the resource room 
to help other students. 
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APPENDIX A 
DATA COLLECTION AND ANALYSIS 

Student Data Form 

The one-page form is filled out by siaff for each participating and mainsireamed student. OREA gathers 
data from this form on backgrounds, demographics, academic outcomes, attendance, referrals, and eat from the 
program. 

Protect Director's Questionnaire 

The Project Director's Questionnaire includes questions on staff qualifications, program implementation, 
periods of instruction, and instructional materials and techniques. 

Project Director's Interview 

The interview gathers information on program and student or staff characteristics not supplied by the 
Project Director's Questionnaire. The interview also allows project staff to offer qualitative data or amplify 
responses to the Questionnaire. 

Citvwide Test Scores 

OREA retrieves scores centrally from the Language Assessment Battery (LAB) and other citvwide tests. 
For evaluation purposes, these test scores are reported in Normal Curve Equivalents (N.CE-s). N.CE.s are 
normalized standard scores with a mean of 50 and a standard deviation (s.d.) of 21.06. They constitute an equal- 
interval scale in which the distance is the same between any two adjacent scores. A gain of 5 N.C.E.S is the same 
whether it is at the lower or the higher end of the scale. N.CE.s can be used in arithmetic computations to 
indicate group progress. (Percentile scales, although more familiar to many, are unsuitable for such computations 
since they are not equal-interval.) 

Likert-Tvpe Surveys 

Likert-type surveys, in which respondents mark their opinions on a scale from one to five, are used in a 
variety of ways. They examine student attitudes (i.e., toward school and career, native language use, and native 
and mainstream cultures). They also assess staff and parent attitude and reactions to workshops and other 
activities. 

Gap Reduction Evaluation Design 

OREA uses a gap reduction design for measuring changes in standardized tests. Since no appropriate 
non-project comparison group is available in New York City, where alt students of limited English proficiency 
(LEP) are entitled to receive supplementary services, OREA compares the progress of participating students with 
that of the group on which the lest was normed. It is assumed that the norm group would show a zero gain in 
the absence of instruction, and gains made by project students could be attributed to project services. 
(See "Citywide Test Scores" above.) 

To test whether pre/posttest gains are greater than could be expected by chance alone, OREA uses a 
t-test. To determine whether a difference between two proportions (e.g., program and mainstream attendance 
rates) is greater than could be expected by chance, OREA uses a g-test. The level of significance is set at .05 for 
ail tests. 




